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Outline 

• sRGB - DX9, DXIO, XBox 360 


• Tone Mapping 

• Motion Blur 
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sRGB Outline 

• sRGB & gamma review 


• Alpha Blending: DX9 vs. DXIO & XBox 360 


• sRGB curve: PC vs. XBox 360 
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sRGB Review 

Terminology: 


• Color textures are stored in "gamma space” 


• Want our pixel shader to run in "linear space” 


PC Gamma 



sRGB Read 



PC Gamma to Linear 



PC Gamma 
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sRGB & Gamma Conversions 


sRGB Read 


PC Gamma Linear 

sRGB Read 




Texture pc Gamma to Linear 



sRGB Write: 



PC Gamma 



Hardware 

Gamma Curve: 
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PC Gamma Monitor Gamma 
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Alpha Blending w/ sRGB Writes 
DX9 vs DXIO & XBox 360 
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[jSaiTigDevelopers: 

[gori^nce 



Alpha Blending w/ sRGB Writes 
DX9 vs DXIO & XBox 360 



Notice the thicker smoke, glows on the gravity gun, and health GUI 
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Alpha Blending on DXIO HW and XBox 360 


I^^Developers: DX9 with sRGB writes 





DXIO & XBox 360 with sRGB writes 

Linear 


PC Gamma 
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I mportant Details 

• DXIO hardware running on DX9 will blend 
with DXlO's behavior! 


• This affects DX9 games that have already 
shipped! 
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Solutions 

1 . Detect DXIO behavior and simulate the 
sRGB write in shader code forcing gamma 
blending 


2 . Let your artists tweak your materials for the 
obvious cases 


We chose #2, and the artists only modified 40 
out of thousands of materials in HL2, Epl, 
Ep2, TF2, and Portal 
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Example From Half-Life 2 
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.(SanigDevelopers: 

EaiifiSlnce i— 


sRGB Curve: PC vs. XBox 360 

• PC hardware uses the actual sRGB curve 


• XBox 360 uses a piecewise linear approximation to 
the sRGB curve 


PC Gamma 



360 Gamma 
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NOTE: The srrooth curve representing the PC sRGB curve in these slides doesn't 
accurately represent the actual sRGB curve that is linear in the low end. 
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Different Gamma Spaces 

• We stopped using the term "Gamma Space" 
and instead... 
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• "PC Gamma Space" - Official sRGB curve 

. "360 Gamma Space" - Piecewise linear sRGB 
approximation found on the XBox 360 

• "Linear Space" 
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PC Gamma on PC 
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(Using PC Gamma textures on the PC) 
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Uncorrected 360 Results 




(Using PC Gamma textures on the XBox 360) 
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What J ust Happened? 

On PC, linear in pixel shader: 



On 360, nonlinear in pixel shader: 


PC Gamma 
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Bad Gamma! 

Render Target 
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SSairigDevelopers: 

EaiifiSlnce i— 


Solutions 

1 . XBox 360-only developers: Use a 
Photoshop color space plug-in 

2 . Simulate sRGB reads and writes in shader 
code (Performance!) 

3. Convert color textures at tool time and use 
the hardware gamma curve 


Orange Box uses #3. Let's take a closer look... 
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.(SanigDevelopers: 

EaiifiSlnce i— 


The Orange Box Solution for XBox 360 

• Want to use the hardware "sRGB" reads & writes 

• We can modify the input textures so that the 360's 
piecewise linear read gets us to linear space! 


Preprocess: 


Run-time: 


PC Gamma 


Linear 




360 Gamma 



/ 

I Texture 


5RGB Read 



360 Gamma to Linear 




Linear to 360 Gamma 


sRGB Write 



Linear to 360 Gamma 


360 Gamma 



/ 

I Texture 


360 Gamma 



/ 

Render Target 
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• But, 360 gamma space looks wrong on a TV or 
monitor! Need to get back to PC gamma space... 


VALVE 


WWW.GDC0NF.COM 

























Using the Hardware Gamma Curve 




We also use the hardware gamma curve to optionally 
correct for "blacker-than-black" colors displayed on 
a television and the deeper gamma of televisions. 
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^anii^nce 
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XBox 360 Lossy sRGB Read 
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CMP 


• I n linear space, the lossy range is 0.0-0.14, so generally OK. 
This caused very few issues for us, but... 

• Don't use the hardware sRGB reads for post processing or 
feedback effects! Simulate the piecewise linear sRGB read in 
shader code...it's only —11 asm instructions. 
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sRGB Summary 



• Alpha blending differences exist 

• We let the artists tweak around this 


• XBox 360 has a different gamma space 

• Convert color textures PC -> 360 Gamma Space 

• Set hardware gamma ramp for end correction 

• XBox 360 HW sRGB read is lossy at the dark 
end (in linear space, 0.0-0.14) 
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Tone Mapping Outline 

• Brief overview of Valve's HDR rendering 


• Building the histogram 


• Computing the tonemap scalar 


*4 
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Overview of Valve's HDR Rendering 

• Lighting data and environment maps are 
stored in HDR linear space 


• Every pixel shader scales the linear HDR 
value by our tonemap scalar (Back buffer is 
RGBA8888!) 


• I ncrementally build histogram each frame 

• Tonemap scalar is generated from the 
current histogram each frame 



• More details on the first 2 points: 

http: //WWW, valvesoftware. com/publications, html 
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Building the Histogram 



Amortize the cost of building the histogram over 16 
frames 

• Update one bucket per frame 

• Sample post-tonemapped frame 

Use an asynchronous occlusion query to count pixels 
in range 
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Sampling Each Histogram Bucket 















Evaluating the Histogram 
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Our first implementation was based on median 
luminance (Shipped in HL2: Episode One, Day of 
Defeat, Lost Coast) 



(NOTE: All histograms are in linear space!) 




But, we ran into too many cases in The Orange Box 
that caused tonemapping to behave strangely. 
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This environment was tonemapping too dark 
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Bright Pixels Matter 


Experiment: Dont use median luminance (50%) 

Use a different histogram threshold: Keep 5% of bright pixels 
in top bins 


@95% 

95% of the pixels 5% of the pixels 





95% of the pixels 


@95% 

5% of the pixels 


; 4jrjD 
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This worked great! Except for... 
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Zombies on Fire! 



Bright pixels from the fire caused 
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Need a Secondary Rule 


• Primary rule: Brightness threshold 

• Secondary rule: Use median luminance as a darkness barrier 



(NOTE: All histograms are in linear space!) 
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(SairieDevelopers: 

gaiifitlnce i— 


This worked! But we still had one issue... 



Zombies Fixed With Both Rules 
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Oscillations From Blinking Lights 



Blinking lights cause oscillations in the histogram that 
cause unwanted oscillations in the final tonemap scalar! 
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The "Sticky Bin" 

• Make bin containing 95% target "sticky" 




This causes minor variations in light to have no effect 
until passing threshold 
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“Sticky Bin" Fixes Oscillations 
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Final Tonemapping Heuristics 

1. Bright pixel threshold 


2. Median luminance (darkness barrier) 


3 . Sticky bin 
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(A section from the non-real-time Portal trailer 2006) 
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A Motion Blur Goals 


[gaiTielDevelopers: 

[goritacgnce 


0 


• I solated, self-sufficient system 

• Shader models 2.0, 2.0b, 3.0 

• No additional memory (system or video) 

• Performance! 

• I don't want to spend more than one week 
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Evaluating Types of Motion Blur 


1 . Cannera rotations - Can be done in post 

2 . Camera translations - Needs depth or 
vector image for correct parallax 

3. Object translations - Needs vector image or 
"fins" 

4. Object rotations & animation - Needs 
vector image or "fins" 


• We chose #1 with some of #2 
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Motion Blur: Where in the Pipeline? 

We don't want to blur the weapon! 



1 . Render full scene 

2. Motion blur 



3. Render view model / weapon 

4. Render GUI 
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Rendering Motion Blur 
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Camera Rotation: Pitch 

• Blur vector is just vertical 
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Camera Rotation: Yaw 

• Not as simple as pitch 


• Need two separate solutions 


• We roll when we turn left/right while looking 
down! 
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Camera Rotation: Yaw (Part A) 

• Blur vector is horizontal 


CMP 




• This fades in/out with pitch 
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Camera Rotation: Yaw (Part B) 

• Roll motion blur 

• This fades in/out with pitch 
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mm 
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This approximation is very efficient to implement! 
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Portal Falling Blur 




• When falling and looking down generate 
forward motion vectors 
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Generating the Final Blur Vector 

• Blur vectors computed per-pixel: 

• Pitch: Full screen vertical vector 

• Yaw: Full screen horizontal vector 

• Yaw: Roll vector 

• Falling: I nside/out vector 


• Combine these individually weighted vectors 








CMP 


• Sample along the vector and average 
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Special Case: Portal Transitions 


• Moving through portals caused a jolt 



• Use last frame's blur values when moving a 
far distance in a single frame 
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Special Case: System Hitches 



CanigDevelopers: 

eojifi^nce 

[08 


Another process stole CPU cycles from the 
game and caused a hitch 

• 'You've got mail!" 

• 'Time to update your software!" 


• System hitches can cause one very blurry 
frame 
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• Time lapse between frames greater than 0.1 
seconds, we disable motion blur for that 
frame 
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Special Case: Headache 



• Variable frame rate and blur made people sick 



CMP 


• Only an issue when frame rate is low with variable frame 
rate (Does not apply to the 360 since we're vsync'd!) 

• Motion blur vector is globally scaled down as frame rate 
drops from 50-30 fps 

• Use minimal motion blur to achieve the effect. We only use 
15% of full-frame shutter! 

• Limit blur to 4% of screen width 
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Motion Blur Summary 

• I solated system 

• Blur from camera rotation only 

• Special case Portal falling blur 

• Acceptable performance & no additional 
memory 

• 90% of Orange Box customers 
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Summary 


• sRGB - DX9, DXIO, XBox 360 

• Tone Mapping 

• Motion Blur 

• Additional details about our rendering: 

http: //WWW. valvesoftware.com/Dublications. html 
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Thanks! 


Alex Vlachos, Valve 

a lex(g) va I vesoft wa re. com 
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